AD~A042  64S 
UNCLASSIFIED 


ILLINOIS  UNIV  AT  URBANA-CHAMPAION  COOTOINATCO  SCIENCE  LAB  F/B  9/4 
AN  EFFICIENT  ALGORITHM  FOR  THE  SPECTRA  OF  BLOCK  COOED  PAM  SIGNA— ETC(U) 
JUN  77  V 01  EULIIS  OAAB07»72-C-02S9 

R-771  ml 


AO  No. 

DOC  FILE  COPY.  AD  A 0 4 2 (3  4 8 


S S COORDINATED  SCIENCE  LABORATORY 

AN  EFFICIENT  ALGORITHM 
FOR  THE  SPECTRA 
OF  BLOCK  CODED 
PAM  SIGNALS 

VAL  DI  EULIt$ 


UNIVERSITY  OF  ILLINOIS  - URBANA,  ILLINOIS 


I 


UNCLASSIFIED 


, security  classification  of  this  page  (Whmn  Dmtm  Enfr*d) 

REPORT  DOCUMENTATION  PAGE  BEFORlVSETmo^/oRM 

t REPORT  NUMBER  |2.  GOVT  ACCESSION  NO  3 RECIPIENT’S  CATALOG  NUMBER 


4 title  (and  Subllllm) 

AN  EFFICIENT  ALGORITHM  FOR  THE  SPECTRA  OF^LOCK 
CODED  PAM  SIGNALS  . ' 


17.  AUTmOROJ 


Val  /t)i ^uliis 


5.  TYPE  OF  REPORT  6 PERIOD  COVERED 


' Technical yXepovt*  ^ 


R-77K 


E.  CONTRAC  ( UWART  NUWERf)  - 

, ; DAA^7-72-C-d25?A'> 

>ASF-ENG-75-22621  ' < 


* PERFORMING  ORGANIZATION  NAME  AND  ADDRESS 

Coordinated  Sc4ence  Laboratory 

University  of'^-Illinois  at  Urbana-Champaign 

Urbana,  Illinois  61801  ^ 

II  CONTROLLING  OFFICE  NAME  AND  ADDRESS 

Joint  Services  Electronics  Program 


13.  N 


TT  PROGRAM  ELEMENT.  PROJECT.  TASK 
AREA  h WORK  UNIT  NUMBERS 


IE.  PCaoRT  QAT^ 

Junm  »77^ 


UMBER  OF  PAGES 


H monitoring  agency  name  ft  ADDRESSri/  trom  ControUing  OWcm)  15.  SECURITY  CLASS,  (oi  thl»  fport) 

UNCLASSIFIED 

I5«  DECLASSIFICATION  'downgrading 

schedule 

16  distribution  STATEMENT  ^o/ RtpofO 

Approved  for  public  release;  distribution  unlimiited 


17  DISTRIBU  TION  STATEMENT  (ot  fh*  mbttrmet  mntmrmd  In  Block  20,  H dIUoront  from  Roport) 


16  SUPPLEMENTARY  NOTES 


1 19  KEY  WORDS  (Conflnuo  on  rovorao  tido  // n«co«««ry  ond  Idontlfy  by  block  ntrmbor) 


Spectral  Analysis 
Line  Coding 


^ ABSTRACT  ^ConUnuo  on  rovorao  »ldo  If  nocm»»ory  mnd  Idmnttfy  by  block  numbmr) 

Tl.a  power  spectral  density  of  multi-level  coded  sequences  has  been  an  important 
factor  in  the  design  of  PCM  transmission  schemes.  The  spectral  density  for 
symbol-by-symbol  encoding  schemes  was  first  derived  by  Bennett.  In  the  past 
few  years,  several  algorithms  for  block  encoded  schemes  have  been  proposed. 

The  most  recent  algorithm  is  based  on  a generalization  of  Bennett's  formula 
and  a compact  notation  for  finite  state  machine  encoders.  This  paper  derives 
closed  form  expressions  for  the  covariance  sequences  of  multi-level  block 
coded  sequences  and  relates  these  covariance  coefficients  to  Bennett's  formula\ 


DO  , 1473  EDITION  OF  I NOV  65  IS  OBSOLETE 


UNCLASSIFIED 


security  CLASSIFICATION  OF  TKifVAGE  Dotm  Bnfrod) 

o'* 


AN  EFFICIENT  ALGORITHM  FOR  THE 
SPECTRA  OF  BLOCK  CODED  PAM  SIGNAI.S 

by 

Val  DiEuliis 


This  work  was  supported  by  the  National  Science  Foundation 
under  Grant  NSF  ENG  75-22621;  additional  support  was  provided  by 
the  Joint  Services  Electronics  Program  (U.S.  Army,  U.S.  Navy  and 
U,S.  Air  Force)  under  Contract  DAAB-07-72-C-0259. 


r 


F 

r 

r 

r 

I 


Reproduction  in  whole  or  in  part  is  permitted  for  any 
purpose  of  the  United  States  Government. 


D D C 

AUC  9 1977 

OliiLTSIbUTTEl 

D 


DISTP.IBUTIOW  STATEMLN’T  ' A 

Approved  for  public  lolcasei 
Disliibulioti  Unlimited 

Abstract 


The  power  spectral  density  of  multi-level  coded  sequences  has 
been  an  important  factor  in  the  design  of  PCM  transmission  schemes.  The 
spectral  density  for  symbol -by-symbol  encoding  schemes  was  first  derived 
by  Bennett.  In  the  past  few  years,  several  algorithms  for  block  encoded 
schemes  have  been  proposed.  Itie  most  recent  algorithm  is  based  on  a 
generalization  of  Bennett's  formula  and  a compact  notation  for  finite 
state  machine  encoders.  This  paper  derives  closed  form  expressions  for  the 
covariance  sequences  of  multi-level  block  coded  sequences  and  relates 
these  covariance  coefficients  to  Bennett's  formula  such  that  the  ensuing 
algorithm  is  more  efficient  in  time  and  memory. 


I.  Introduction 


The  power  spectral  density  of  multi-level  coded  sequences  has  been 
an  important  factor  in  the  design  of  PCM  transmission  schemes.  In  [ l] , 
Bennett  derived  the  formula  for  the  spectrum  of  a symbol  by  symbol  encoding 
scheme.  An  algebraic  method  for  computing  the  spectrum  was  given  by  Tsujii 
and  Kasai  in  [2].  In  [3]  , Yasuda  describes  a more  direct  method  of  computa- 
tion. Boslk  [4]  derived  expressions  for  the  autocorrelation  sequence  of  a 
block  coded  signal,  but  did  not  show  a closed  form  expression  for  the  power 
spectral  density.  In  [5],  Cariolaro  and  Tronca  develop  an  efficient  closed- 
form  algorithm  for  the  computation  of  the  spectral  density  of  multi-level 
block  codes  with  encoders  described  as  finite  state  machines. 

This  paper  derives  closed  form  expressions  for  the  covariance 
sequences  of  multi-level  block  codes  and  relates  the  covariance  coefficients 
to  Bennett's  formula.  In  many  ways  the  development  follows  [5],  however 
a more  efficient  notation  which  may  be  considered  as  a generalization  of 
[b]  , yields  an  algorithm  which  is  computationally  more  efficient  in  time 


and  memory. 
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II.  Definitions  and  Notations 
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The  class  of  encoders  considered  in  this  report  may  be  described 

by  means  of  a finite  state  machine.  Let  the  quintuple  = {j 

denote  the  encoder  with  S = [0,l}  , Inputs  consisting  of  sequences  of  K 

N 

binary  symbols  (input  blocks),  Oc  L , outputs  consisting  of  sequences  of 
N L-ary  symbols*  (output  blocks  or  codewords),  (N  ^ K),  and  = [l,2,...,l), 
a finite  set  of  states  conveniently  denoted  as  integers.  The  output  function, 
f:c9  X J — O can  be  described  as  a set  of  functions  F = [ f ^ , f 2 , . . . , f where 

f -•  The  mapping  f^  shall  be  referred  to  as  the  encoding  mode  cor- 
responding to  state  i.  Furthermore,  we  shall  call  a codeword 
a = (a^  ^ \a^^\ . . . ) , with  each  a^^^  € L,  an  element  of  state  i if 

fj^(b)  = a for  some  b € J. 

The  input  block  sequence  is  assumed  to  be  stationary  (i.e.,  each 

distinct  block  of  K bits  properly  framed)  with  each  block  statistically 

K A 

independent.  For  each  b;u=l,...,2  =Q,  its  associated  probability 

Q 

will  be  denoted  q . Of  course  we  have  the  condition  Z!  q =1.  This 
u , ^u 

u=l 

binary  random  process  is  transformed  into  an  L-ary  random  process  by  the 
encoder.  The  encoded  process  may  be  represented  as  in  Fig.  1 below. 


»0  ^0  ^0  I ®1  ®1  ®I  I ' \ ®k  ®k  I 


Figure  1.  Channel  sequence 


The  elements  of  L shall  be  considered  integers  with  L > {i|  |f|  ^ |l|  - 2} 
for  L odd,  and  L ~ | |i|  & ^ |l|  and  I ^ O]  for  |l|  even. 
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This  representation  shows  the  symbol  sequence  properly  framed 
with  respect  to  the  words  of  length  N.  The  symbol  aj^  represents  the 
i digit  of  the  codeword  in  the  channel  sequence.  We  will  refer  to 
the  time  of  transition  from  word  a^  to  the  symbol  transition 

a^^^  to  as  word time  i.  Note  that  the  sequence  representation 

explicitly  shows  the  state  sequence  of  the  encoder.  We  shall  also  adopt 
the  convention  that  the  state  transition  from  s^  to  occurs  at 

wordtime  i. 

At  wordtime  n,  a new  binary  block  is  input  to  the  encoder  and  the 

state  transition  function  changes  the  internal  state  of  the  encoder  accord- 

* 

ing  to  = g(s^,b^)  . Under  the  assumption  that  the  binary  input 

process  is  stationary  with  statistically  independent  elements,  it  is 
easily  shown  that  the  state  sequence  is  a homogeneous  Markov  chain.  Let 

be  the  set  of  input  words  which  cause  the  encoder  to  change  from  state  i 
to  state  j [i.e.,  = {b  € j|j  = g(i,b)j]  and  denote  the  one-step  transition 

matrix  of  the  state  process  as  n = > then 
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A restriction  we  place  on  II  (hence,  the  state  transition  function,  g)  is 
that  the  state  sequence  be  a fully  regular  homogeneous  Markov  chain.  For 
this  class  of  state  transition  matrices,  there  exists  II  * lim  II*^  where 


n -•  00 


.(n), 


denotes  the  matrix  of  n-step  transition  probabilities. 


The  symbols  s , and  b shall  always  be  interpreted  as  the  state  of  the 
encoder  at  wo9dtime  n^  and  the  input  block  at  time  n respectively. 


f 


Furthermore,  consists  of  identical  rows  £ ■*  [ , . . . , p j.]  , such  that  £H  = £. 

The  vector  £ is  called  the  stationary  probability  distribution. 

The  channel  symbol  sequence  is  cyclo-stationary  with  period  N. 

(1 ) 

Hence  the  mean  of  the  process  is  periodic  with  period  N.  Let  a.  ^ L 

denote  the  digit  of  the  codeword  in  state  i corresponding  to  input  word 

b^.  Assuming  the  encoder  to  be  in  state  i,  the  conditional  mean, 

E[a^^^|s  » i]  , is  given  by: 

n n 

E[a^^^ls  = ij  = 2 a^^^q  = 2 f 2 aj^^q  ] 

" u=l  j=l  ^ 6 ' • 

For  reasons  which  will  become  clear  later,  let  us  define 

(£)  A „ 

”lj  - I,  “lu  % 

“ ^ 'ij 

as  the  digit  transition  weight  from  state  i to  state  j,  and  let  the 
matrix  jj  ; i,j  = 1,.,.,I.  Thus, 


ECa^^^ls  = i]  = E m^^"'  . 
n ' n ij 


After  averaging  over  the  ensemble  of  states  we  arrive  at 


(£)  A „r  (£)-,  I r « 

p ■ ELa^  J - E p^  E m^  - £M^  u 


i-1  i-1 


where  u is  the  (I  x 1)  column  vector  of  I's. 

Since  we  are  ultimately  Interested  in  obtaining  an  efficient 
algorithm  to  compute  the  power  spectral  density  of  the  random  sequence,  we 


shall  need  an  efficient  -representation  for  the  covariance  sequence 
s k s “ where  - E[(a^-^^  - is  the 


covariance  for  elements  in  the  encoded  sequence  which  are  separated  by 
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(k-1)  symbols.  The  dependence  of  v on  the  time  reference  j is  not  included 
as  the  covariance  is  calculated  as  the  arithmetic  mean  of  the  N symbol 
covariances  for  i=l,..,,N.  This  tacitly  assumes  that  the  symbol  sequence 
is  wide-sense  stationary  since  an  observer  would  not  know  the  proper 
framing  of  the  symbol  sequence. 

The  covariance  coefficients  shall  be  represented  by  the 
contribution  to  from  within  a single  codeword  and  the  contribution 
from  different  codewords  in  the  channel  sequence.  For  example 


0 N 


s=l 


= i E E E {(op)  - p q 

i=l  u=l  s=l 

-iz  £ ? {.(■>„<=>  -2  p.„ 

N . , , , iu  iu  iu  '^i^u 

i=l  u=l  s=l 


1 r I Q N , , „ 

1 i'  V / (s).2  \ „ . (.t  KZ  i 

N L'.p,  ^/“iu  ) PiV  • ) J 

i=l  u=l  s=l  t=l 


(2.1) 


This  expression  was  developed  as  follows:  assuming  the  encoder 
to  be  in  state  1,  each  digit  of  each  codeword  (minus  the  digit  mean)  is 
correlated  with  Itself,  then  these  quantities  are  averaged  over  the 
emsemble  of  states. 

The  same  representation  can  be  used  to  calculate  v^,  where  each 
symbol  is  correlated  with  its  adjacent  symbol  within  the  codeword.  However, 
when  correlating  the  last  digit  with  its  adjacent  symbol,  we  find  ourselves 
concerned  with  the  next  codeword  in  the  sequence.  This  leads  to  our 
consideration  of  the  coefficients  being  comprised  of  two  terms;  a term 
representing  the  contribution  to  the  coefficient  from  within  a single 


I 
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codeword,  and  a term  representing  the  contribution  of  the  correlation 
between  symbols  in  different  codewords.  Furthermore,  it  should  be  easily 
seen  that  a contribution  from  within  a codeword  is  non-z'^ro  only  for 
coefficients  Vq,...,Vj^_P  Therefore,  we  shall  represent  , k = 1 N-1  as 


k N ''  k 


« + ) 


with  being  the  contribution  from  within  a single  codeword  and  being 
the  contribution  from  adjacent  codewords  in  the  sequence. 

The  component  is  a direct  generalization  of  (2.1),  and  is 
expressed  as 


1 Q N-k  , , , ,,  , ,N-k  _ . , , , 

I ^ ^ V (s)  (s+k)  , „ (t)  (t+k) 

V,'  = E E E a.  o.  'q  p.  - i E V 

k , , , , lU  lU  ^U^L  '.,1  '' 

i=l  u=l  s=l  t=l 


(2.2) 


To  simplify  notation  we  shall  define  the  N column  vectors,  (k  = 0,,..,N-1) 


having  elements 


A ^ (s)  (S4k)  . 

'^ki  "lu  iu  '^u’  ^ 

U=1  S=1 


as  the  codev;ord  contributions  to  (the  autocorrelation  coefficient). 

The  element  w,  ^ of  W,  is  called  the  contribution  to  p,  by  state  i.  These 
k i — k k ^ 

definitions  allow  us  to  express  as 


v>  . 

k — Tc  , 

s = l 


(2.3) 


The  determination  of  is  complicated  by  the  fact  that  the  state 
transition  must  be  considered.  Assuming  the  encoder  to  be  in  state  i,  we 
have  the  conditional  expectation 


7 


I 

j =1  u € B . . s 
ij 


N Q 


=N-k+l  v=l  J'' 


After  averaging  over  all  states  and  rearranging  terms  we  obtain 


N r r I I 


V"  = 

k 


^ l{r  E p.  ; E q 

M . • 1 . , 1 L , „ lu  jL  ,^v  jv 

N-k+1  1=1  1=1  u € B v=l 

tj 


(s-fk-N)i,  , (s)  (s-H<.-N)Vl 

jj  - p'  'J 


We  can  substitute  the  matrix  notation  developed  earlier,  which  yields 


(2.4) 


However  u * £ = and  since  = U (the  identity  matrix)  we  finally  arrive  at 


N 


,0 


^ pM  (E  - n )M  , n 

S=N-k+l  S+K  N- 


(2.5) 


Hence,  upon  combining  (2.3)  and  (2.4),  we  have 


k -i' - ^.)",kk-N  ^ 

S=1  s=N-k+l  ^ 


for  k = 1 , . . . ,N-1. 

For  the  remaining  covariance  coefficients,  k ^ N,  the  same 
notation  may  be  used.  Consider  Fig.  2 below  representing  the  encoded 


sequence  . 
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I « 

j" ■■■■[  j 

'00  0 0 0''r  r r r+1  r+1 

• I 

Figure  2. 


,(N)| 
r+1  ' 


The  dotted  lines  indicate  the  extremes  of  symbols  involved  in  the  calculation 

of  V = V „ In  other  words, 

k rN+t  ’ 


.N-t 


S = 1 


+ E E ([a^">  - 


s=N-t+l 


Both  of  the  sums  in  this  expression  are  of  the  same  form  and  the 

expectations  can  be  represented  as  in  (2.5)  with  an  additional  sum  which 

takes  into  account  the  nxHnber  of  state  transitions  occurring  between 

and  a for  the  first  sum,  and  and  a , in  the  second  sum.  With  this  in 
— r ’ 0 r+1 

mind,  we  can  immediately  obtain 

^N+t  = N i ^ • ^co)Ms+t  - "»>”s+t-N  4* 

s»l  s*=N-t+l 

It  must  be  noted  that  when  t = 0 (i.e.,  for  covariance  coefficients  at 
Integral  multiples  of  N),  the  second  term  is  understood  to  be  zero. 

The  expressions  for  the  covariance  coefficients  are  summarized 
in  Table  1 below. 


I ■ 


•ai  c. . 
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III.  Z-Transform  Approach  to  Spectral  Analysis 


In  its  most  general  form  Bennett's  formula  for  power  spectral 
density,  S^(f),  for  the  discrete  encoded  process  is  as  follows: 

S (f)  = V + 2 Z V cos  2nfk  + ^|  Z f Z ^.(f  - ^ (3.1) 

k=l  i=l  i— ^ 


where  and  are  the  covariance  coefficients  and  digit  mean  values 

respectively.  The  6(*)  is  the  Dirac  impulse  function. 

The  spectrum,  seen  to  be  composed  of  a continuous  portion 

(denoted  as  X (f))  and  a discrete  portion  (denoted  X.(f)),  is  periodic  with 
c d 

unity  period.  Note  that  the  discrete  lines  are  spaced  at  multiples  of  l/N. 

Since  the  covariance  sequence  is  even,  it  is  easily  seen  that  the 
z-transform  of  the  sequence  {v  } can  be  expressed  as  R(z)  + R(z  S where 

V 00  ^ 

R(z)  = -y  + Z z • Furthermore,  it  should  be  apparent  that 

k=l 


X^(f)  = 2Re{R(e^^"^^)} 


(3.2) 


For  the  next  step  in  the  derivation,  we  shall  express  R(z)  in 
terms  of  the  matrix  expressions  for  the  covariance  coefficients  developed 
in  Section  II. 


It  is  convenient  for  us  to  express  R(z)  as  follows: 

-(iN+j) 


V N-1  ® ® N-1 

R(z)  - f ^ Z v^z-"  . r v^^z--'"  * 


k=l 


(3.3) 


r-1 


Upon  making  the  appropriate  substitutions  from  Table  1 into  (3.3),  we  obtain 


11 


1 r ^ r 2 1 N-k 

N • R(Z)  = 2 L£^0  - ^ + I I . z 

s=l  k*l  s*l 


(s)  (S4k> 
M.  M. 


+ E £M  rn  - n )m 


-k 


s=N-k+l 


s+k-N  — 


00  N 

+ E E 
r=l  s=l 


,r-l 


[£Mg(n  - n^)M^  u|  ^-rN 


® N-1  _N-k 


+ E 


,t-l 


E L E £m  (n^  - n^)M  u 

t=l  k=l  '"s-1  “ s-fk 


+ E £m  (n^  - n„)M  u|  r<'^N-Hc) 
s-N-k+1  ^ 


rearranging  terms  and  changing  the  index  of  summation  t,  we  arrive  at 

N • R(z)  - I i^W  - E - V z"’" 

s=l  ■ k=l  ^ ^ s»l  -* 


00 

N-1 

pN-k 

E 

E 

r=0 

0 

1 

^s-1 

N-1 

r 

1 

N 

E 

2 J 

k-1 

s=N-k+l 

>'*s-Hc  ii  ^ 


■(rN-tk) 


- (iN-fk) 


(3.4) 
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In  order  to  simplify  the  notation  we  define  N constants  as  follows: 


J {£W  Q-  E ; k=0 

S«1 


CD  * 
k 


(3.5) 


, £W  - E , k=l,...,N-l. 

1 s = l 


Further  simplification  of  (3.4)  is  possible  since  only  the  state 
transition  matrix,  II,  and  z are  dependent  upon  the  summation  indices  i and  r. 
After  the  appropriate  rearrangement  we  obtain 


N • R(z)  ■=  E ou.  z"  + z‘  T.  E pM  ( i:  [r/  - n ] z'^^jM  , u z 
k , s \„  „ ® / s+k— 


N-1  N-k 
E E 
k=0  s=l 


r=0 


(3.6) 


N-1  N / °°  i 4M\ 

+ E E £M  ( E [n^  - n Jz'^”)  M ^ „ u z"*". 

I 1 ..  M u-Li  s n ' s+k-N  - 

k”l  s=N-k+l  1=0 


Following  the  development  given  in  [5] , we  have  the  equalities 

CO 

E [n*"  - njz'’^'^  - z^u  - n^)[z\  - (n  - n^)]‘^  - (u  - n^)c/D(z^) 
r-O 

k 

where  XD(X)  = X E » (<^0  • 1).  is  the  characteristic  polynomial 

k=0 

of  n - IIj^  and  G is  called  the  conjoint  matrix  of  II  - The  conjoint  matrix 

can  be  written  as  a polynomial  with  matrix  coefficients  of  the  form 


f 
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N(k-l) 


G = E G_  z"'-'  (G.  = 0,  G_  = U). 


k=0 


I-k 


(3.7) 


Substitution  of  (3.7)  into  (3.6)  and  some  algebraic  manipulation  leads  to 


N-1  I , N-1  N-k 

N . R(z)  = Z 0)  z'  +2IS  [Z  Z m g M z^t-k-l 
k=0  t=l  ^k=0  s=l  ^ ^ 


N-1  N 

+ r Z M G_  ^ „z 

k=l  s=N-k+l  " 


N<t+1)  - 


where  - (u  - n_)Cj_^. 

The  polynomial  in  the  numerator  of  the  second  term  is  of  degree 
(I+l)N-2.  In  order  to  develop  a convenient  method  of  computation  for  the 
scalar  coefficients,  we  shall  define  two  sets  of  vectors  as  follows: 


1)  31ts  “ £-”s^I-t=  ^ and  s - 1.....N, 


(3.9) 


2)  §„  = Mu;  s - I,...,N. 

— ~5 


The  NI  are  seen  to  be  (1  X i)  row  vectors  and  the  ^ are  (I  X 1)  column 
vectors.  Substituting  these  vectors  into  (3.8)  yields 


N-1 


I ,N-1  N-k 


i.  , r /«  1. 

N . R(z)  - Z ou  z'*"  -H  2 2 T),.  ? 


Nt-k-1 


k-0 


t“l  k»0  s«l 


s+k 


N-1  N 


+ ^ ^ „ 2 
k-1  s-N-k+1 


N(t+1)  - k-lVi,_2N-L,  N 


■)j/z^*^‘S)(z”).(3. 


10) 


\ 

r 

I 


For  a fixed  t,  consider  the  convolution  of  the  two  vector  sequences 

(]l(.j and  (§i»»*..5jj).  which  we  shall  call  the  sequence 

(2N-1)^‘  l^n’^thermore,  consider  the  coefficients  of  the 
numerator  polynomial  in  (3.10).  For  a fixed  t we  can  express  the  coefficient 
of  z for  k p 0 as, 


I 
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IV.  ALGORITHM 

The  development  of  the  expression  for  the  power  spectral  density 
of  the  random  process  generated  by  a finite-state  machine  encoder  allows 
us  to  design  an  algorithm  for  the  efficient  computation  of  both  the  discrete 
and  continuous  spectrum.  We  shall  describe  the  algorithm  in  three  segments: 
input  processing,  main  program,  and  the  point-by-point  evaluation.  The  input 
processing  consists  of  reading  the  codebook,  state  transition  table  and  the 
probability  distribution  for  the  binary  words.  This  data  is  used  to  calculate 
the  state  transition  matrix,  H,  the  N transition  weight  matrices,  , and  the  N 
vectors  of  codeword  contributions  Wj^.  The  main  program  uses  these  quantities  to 
calculate  the  coefficients  of  the  polynomials  which  determine  the  discrete  and 
continuous  spectrum.  Finally,  the  point -by-point  evaluation  calculates  the 
continuous  spectrum  at  any  desired  frequency,  and  evaluates  the  weights  of  the 
spectral  lines. 

The  codebook  is  input  one  codeword  at  a time  with  the  following 

format: 

(a)  codeword  a (N  integers), 

(b)  codeword's  state,  i € 


(c)  the  state  transition,  j € 

(d)  the  probability,  q^,  of  binary  input  b^  € J 
such  that 

For  each  word,  the  following  calculations  must  be  made: 


The  calculations  performed  in  the  main  program  segment  may  be 


summarized  as  follows; 


1 

(a)  computation  of  £ from  £11  = £ and  Up.  =1,  and 

i=l  ^ 

construction  of  0 , 

cc  ’ 

(b)  computation  of  the  vectors  = M^u;  s = 1 N, 

(}  ) 

(c)  computation  of  = £M^u  =£§£;  i-  = 1,...,N, 

(d)  computation  of  ; k = 0 N-1  from  (3.5), 

(e)  computation  of  the  matrix  coefficients,  G . , k = 0,...,I-1, 

1. " K 

and  the  scalar  coefficients  dj._j^;  k = 0,...,I.  This  can 
be  done  recursively  as  follows  (see  [S]); 

(i)  let  F = n - H , then 

\ ^ trace  and, 

"k  = 

where  k = 1 1,  with  initial  conditions 

dg  = 1 and  = U (the  identity).  A check 
can  be  made  on  these  calculations  since 
dj  - 0 and  Gj  - llOii, 

(f)  computation  of  the  vectors  ^ * pM  G.^  « pM_(U"IT  )G 

~^S  S I-t  — S aa'  I-t’ 

for  t ■ 1 1,  and  s - 1,...,N  (note  that  one  matrix 

multiplication  can  be  saved  since  G^  - U), 

(g)  computation  of  the  constants  t » and 

J “ 1,...,2N-1  by  performing  the  convolutions 

* 5 for  t ■ 1,...,I,  where  1)^  and  ^ are  the  vector  sequences, 

(h)  computation  of  the  coefficients  a^,  J - 0 (I+l)N-2. 

This  may  be  done  by  considering  the  I sequences, 
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as  polynomials  of  the  form 


2N-2 


1=0 

The  numerator  polynomial  may  then  be  expressed  as 

V N(t-l),.  ^ ^ 

I.  z C (z). 

t = l 

This  implies  that  the  sequence  of  numerator  coefficients 
may  be  found  by  right-shifting  by  N(t-l)  units  and 
summing  the  set  of  shifted  sequences. 

The  point-by-point  evaluation  segment  of  the  algorithm  computes  th^ 
continuous  spectral  density  for  any  frequency,  f,  from 


N-1 


X (f)  » 2Re  Z (1,  + 


( I+DN-2 

Z 

i=0 


afZ 


2N-1  -N 
z D(z  ) 


N J 


z = e 


j2TTfJ 


This  is  best  accomplished  by  evaluating 


A 1, 

X,(f)  ^ Z Ciiz"'"  , x,(f)  = z 

k-0  i=0 


^ (I+DN-2  ^ 


a^z 


and  D(z^)  for  z ••  and  then  combining  the  result  as 


X^(f)  - 2Re{x^(f)  + X2(f)/z^^‘^D(z^)} 


The  discrete  spectrum  is  found  from 


If  , 2tt^ 

Xd(f)  “ ^ j z - e ”,  £ - 


f 
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V.  PERl'ORMANCE  EVALUATION  (COMPLEXITY  ANALYSIS) 


In  order  to  determine  the  computational  efficiency  of  this 
algorithm,  we  shall  analyze  the  amount  of  data  storage  necessary,  and 
the  number  of  scalar  multiplications  needed  to  complete  the  computation 
of  the  power  spectral  density. 

The  data  storage  (not  including  work  space)  is  itemized  in 


Table  2 


Variable 


Storage  Space  (Integers! 


M^;  s=l N 


B 1 JJ 

■L  9 • • • ) 


k=0,...,N-l 

k=l,...,I 

s=l , . . . ,N 


Ig;  s-1 N 

j-o (i+DN-2 


IN  + N-1 


Adding  the  memory  requirements  shown  in  Table  2 yields  a total  of 


+ I^(2N+2)  + I(3N42)  + 2N-1, 


(5.1) 


The  number  of  scalar  multiplications  will  be  counted  for  each  segment 


of  the  algorithm.  The  input  processing  segment  requires  multiplications  for 


I 


steps  (b)  and  (c).  Step  (b)  requires  N scalar  multiplications  for  each 
codeword.  For  step  (c),  the  sums 


N-k 

/ (S)  (S-ric) 

q ^ O' . a , 

u , lu  lU 

3 = 1 


must  be  calculated  for  k=0,...,N-l,  This  takes 


N(N+1 ) ^ N + 3N 

2 2 

multiplications  for  each  codeword.  Hence,  the  total  number  of  multiplications 
for  the  input  processing  segment  is 


2’^'^  • I(N^  + 5N+1). 


(5.2) 


The  multiplications  necessary  to  complete  the  main  program  are 
summarized  as  follows  (with  reference  to  Section  IV): 


(a)  v(I+l)  ; for  a constant  y depending  on  the  matrix  inversion 
algorithm  used, 

(b)  none,  because  no  multiplications  are  necessary  for  the 
matrix-vector  product  M^u, 

(c)  NI,  (N  inner  products  with  vectors  of  dimension  I), 

(d)  the  N inner  products  of  the  form  £ ^ require  NI 
multiplications,  while  the  sums 


E k=0 N-1 

s=l 

2 

require  lj(N  +N)  multiplications,  yielding  a total  of 
NI  + ^(N^+N), 


r 
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3 

(e)  each  coefficient  , k=l,,.,,I  requires  I 1 and  the  matrix 

coefficients  do  not  require  any  more,  giving  a total  of 
4 

I + I multiplications, 

(f)  the  vectors  require  N prodticts  of  the  form  pM^(U-n^)  = X, 

and  for  each  such  vector,  there  are  T products  of  the  form 

2 3 

X Gj.  lliis  yields  a total  of  2I  N + I N multiplications, 

2 

(g)  each  vector  convolution  requires  N inner  products  of  vectors 

having  dimension  I,  and  since  there  are  I convolutions,  we 
2 2 

need  to  perform  N 1 scalar  multiplications  for  this  step. 

Since  step  (h)  doesn't  require  any  multiplications,  we  obtain  a total  of 

+v(T+l)^  + + I“(N^+2N)  + I(2N+1)  + ’(N^+N).  (5.3) 

The  point-by-point  evaluation  for  the  continuous  spectrum  requires 
the  evaluation  of  3 polynomials  (complex);  two  of  degree  (N-1)  and  one  of 
degree  (I+l)N-2.  Using  Horner's  Rule,  these  evaluations  require  a total  of 
IN  + 3N  - 4 complex  multiplications  (or  4lN  + 12N  - 16  scalar  multiplications) 
for  each  value  of  frequency. 

The  discrete  spectrum  also  requires  the  evaluation  of  an  (N-1)^^ 
degree  polynomial  at  LN/2J  points.  In  addition,  each  point  requires  2 multi- 
plications to  obtain  the  magnitude-squared  value.  Thus  the  total  number  of 
scalar  multiplications  needed  for  the  discrete  spectrum  is 

LN/2J(4N  - 2). 

Since  the  total  complexity  of  the  spectrum  analysis  program  is  sen- 
sitive to  the  number  of  frequencies  (points)  desired,  we  shall  only  consider  the 
input  processing  and  main  program  segments.  Thus,  upon  adding  (5.2)  and  (5.3) 
we  arrive  at 


( 
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2*^’^*I(N^+5N)  + + V(I+1)^  + l\  + I^(N^+2N)  + I(2N+1)  + }(N^-W)  (5.4) 

for  the  total  number  of  scalar  multiplications  necessary  to  execute  the 
algorithm. 

A similar  analysis  of  the  algorithm  given  by  Cariolaro  and  Tronca 
in  [5]  yields 


2*^  [iN+lVl]  +1^  + 21^  +I(N^+3N+2)  + 2N^  + N - 2 
as  the  data  storage  required,  and 


(5.5) 


L 


I 

I 

I 

I 

I 

I 

I 

f 

r 


2*^  [3I^N+I^+I(N^+N)]  + +Y(I+1)^  + 2NI^  + I^(N^+N)  + I(N^+1)  (5,6) 

as  the  total  number  of  scalar  multiplications  (Ignoring  the  pcint-by-point 
evaluation  which  is  the  same  for  both  algorithms). 

Comparison  of  (5.1)  with  (5.5)  and  (5.4)  with  (5.6)  reveals  that  the 
algorithm  based  on  digit  sums  presented  here  is  more  efficient  than  [5]  for 
all  (K,N,I)  codes  in  both  the  amount  of  data  storage  and  number  of 
multiplications.  An  Intuitive  explanation  of  this  increased  efficiency  is 
based  or.  the  amount  of  data  used  in  the  algorithm  described  in  [5]  ; all  of 
the  codewords  are  used  in  all  phases  of  the  computation.  However,  it  is 
seen  from  the  analysis  in  Section  II  that  all  of  this  information  is  not 
necessary  to  determine  the  covariance  of  the  encoded  process,  hence  a more 
efficient  algorithm. 
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